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APPARATUS FOR RE— ORDERING VIDEO DATA FOR DISPLAYS USING TWO TRANSPOSE STEPS AND 
STORAGE OF INTERMEDIATE PARTIALLY RE-ORDERED VIDEO DATA 



The invention relates to integrated circuits for re-ordering video data for 
various types of displays. It finds particular application in conjunction with re-ordering 
video data for plasma discharge panels (PDPs), digital micro-mirror devices (DMDs), 
liquid crystal on silicon (LCOS) devices, and transpose scan cathode ray tube (CRT) 
5 displays and will be described with particular reference thereto. However, it is to be 
appreciated that the invention is also amenable to other types of display and other 
applications. 

New types of displays and new display driving schemes for traditional 
displays (e.g., cathode ray tube (CRT) displays) are emerging with the advent of digital 

10 television (TV), and advancements in personal computer (PC) monitors. Examples of new 
displays include PDPs, DMDs, and LCOS devices. An example of a new driving scheme 
for a display is known as transposed scan. These new technologies rely on digital display 
processing and are typically implemented using a variety of interconnected, individual 
application specific integrated circuits (ASICs). 

15 Traditional displays commonly operate using a raster scanning system. In a 

raster scanning system, displays scan video data in lines and repeat line scanning by 
advancing the scan line in a direction substantially perpendicular to the line direction. In a 
typical raster scan, the lines are scanned in a horizontal direction while the scan line is 
advanced in a vertical direction. Conversely, in devices using a transpose scan approach, 

20 the lines are scanned in the vertical direction and the scan line is advanced in the horizontal 
direction. Transpose scanning is known to improve raster and convergence (R & C) 
problems, landing problems, focussing uniformity, and deflection sensitivity in wide 
screen displays, Transposed scanning may be beneficial for other types of displays, such 
as matrix displays, as well as CRTs. Transposed scanning implies that the video signal 

25 must be transposed as well. 

PDPs typically have wide screens, comparable to large. CRTs, but they 
require much less depth (e.g., 6 in. (15 cm)) than CRTs. The basic idea of a PDP is to 
illuminate hundreds of thousands of tiny fluorescent fights. Each fluorescent light is a tiny 
plasma cell containing gas and phosphor material. The plasma cells are positioned 
30 between two plates of glass and arranged in a matrix. Each plasma cell corresponds to a 
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binary pixel. Color is created by the application of red, green and blue columns. APDP 
controller varies the intensities of each plasma cell by the amount of time each cell is on to 
produce different shades in an image. The plasma cells in a color PDP are made up of 
three individual sub-cells, each with different colored phosphors (e.g., red, green, and 
blue). As perceived by human viewers, these colors blend together to create an overall 
color for the pixel. 

By varying pulses of current flowing through the different cells or sub-cells, 
the PDP controller can increase or decrease the intensity of each pixel or sub-pixel. For 
example, hundreds of different combinations of red, green, and blue can produce different 
colors across the overall color spectrum. Similarly, by varying the intensity of pixels in a 
black and white monochrome PDP, various gray scales between black and white can be 
produced. 

LCOS devices are based on LCD technology. But, in contrast to traditional 
LCDs, in which the crystals and electrodes are sandwiched between polarized glass plates, 
LCOS devices have the crystals coated over the surface of a silicon chip. The electronic 
circuits that drive the formation of the image are etched into the chip, which is coated with 
a reflective (e.g., aluminized) surface. The polarizers are located in the light path both 
before and after the light bounces off the chip. LCOS devices have high resolution 
because several million pixels can be etched onto one chip. While LCOS devices have 
20 been made for projection TVs and projection monitors, they can also be used for micro- 
displays used in near-eye applications like wearable computers and heads-up displays. 

For an LCOS projector, the following steps are involved: a) a digital signal 
causes voltages on the chip to arrange in a given configuration to form the image, b) the 
light (red, green, blue) from the lamp goes through a polarizer, c) the light bounces off the 
25 surface of the LCOS chip, d) the reflected light goes through a second polarizer, e) the lens 
collects the light that went through the second polarizer, and f) the lens magnifies and 
focuses the image onto a screen. There are several possible configurations when using 
LCOS. A projector might shine three separate sources of light (e.g., red, green and blue) 
onto different LCOS chips. In another configuration, the LCOS device includes one chip 
30 and one source with a filter wheel. Tn another configuration, a color prism is used to 
separate the white light into color bars. In other configurations, the LCOS device might 
utilize some combination of these three options. 
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A DMD is a chip that has anywhere from 800 to more than one million tiny 
mirrors on it, depending on the size of the array. Each 16-um 2 mirror (urn = millionth of a 
meter) on a DMD consists of three physical layers and two "air gap" layers. The air gap 
layers separate the three physical layers and allow the mirror to tilt +10 or -10 degrees. 
When a voltage is applied to either of the address electrodes, the mirrors can tilt +10 
degrees or -10 degrees, representing "on" or "off in a digital signal. 

In a projector, light shines on the DMD. Light hitting the "on" mirror will 
reflect through the projection lens to the screen. Light hitting the "off mirror will reflect to 
a light absorber. Each mirror is individually controlled and independent of the other 
mirrors. Each frame of a movie is separated into red, blue, and green components and 
digitized into, for example, 1,310,000 samples representing sub-pixel components for each 
color. Each mirror in the system is controlled by one of these samples. By using a color 
filter wheel between the light and the DMD, and by varying the amount of time each 
individual DMD mirror pixel is on, a full-color, digital picture is projected onto the screen. 

Given these various types of displays and others, it is apparent that it would 
be beneficial to have universal components for processing video data to the displays. 



20 



25 



In one embodiment of the invention, an apparatus for re-ordering video data 
for a display is provided. The apparatus includes a) a means for receiving video data and 
performing a first transpose process on such video data to create partially re-ordered video 
data, b) a means for storing the partially re-ordered video data, and c) a means (22, 122) for 
reading the partially re-ordered video data and performing a second transpose process on 
such partially re-ordered video data to create fully re-ordered video data. 

hi one aspect, the apparatus is adaptable to re-order video data for two or 
more types of displays. In another aspect, the apparatus includes a first transpose 
processor, a storage module, and a second transpose processor. 

One advantage of the invention is that the apparatus is compatible with 
various types of displays (e.g., PDPs, DMDs, LCOS devices, and transpose scan CRTs) 
30 and thereby generic or universal. 

Another advantage is a reduction in unique designs for apparatuses that re- 
order or transpose video data for displays. 
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Another advantage is the increased efficiency in conversion of video data to 
sub-field data for PDPs and DMDs, particularly the increased efficiency of associated 
memory accesses. 

An additional advantage is reduction in development efforts for display 
5 processing systems. 

Other advantages will become apparent to those of ordinary skill in the art 
upon reading and understanding the following detailed description. 

10 The Swings are forpurposes of iUustrating exemplary embodiments of the 

invention and are not to be construed as limiting the invention to such embodiments. It is 
understood that the invention may take form in various components and arrangement of 
components and in various steps and arrangement of steps beyond those provided in the 
drawings and associated description. Within the drawings, like reference numerals denote 
15 like elements and similar reference numerals (e.g., 20, 120) denote similar elements. 

FIG. 1 is a block diagram showing a re-ordering apparatus within an 
embodiment of a display processing system. 

FIG. 2 is a block diagram of an embodiment of the re-ordering apparatus. 

FIG. 3 is a block diagram of another embodiment of the re-ordering 

20 apparatus. 

FIG. 4 is a block diagram of an exemplary embodiment of a first transpose 
processor of the re-ordering apparatus. 

FIG. 5A is an illustrative example of conversion of pixel data to 
monochrome sub-field data. 

25 F 10 - 5B is m illustrative example of conversion of pixel data to R, G, and B 

sub-field data. 

FIG 5C is an illustrative example of temporary storage of sub-field data for 
an exemplary sub-field (i). 

FIG 5D is an illustrative example of temporary storage of RGB sub-field 
30 data for an exemplary RGB sub-field (i). 

FIG. 6 is an illustrative example of the display of sub-fields over time in 
relation to the display of a frame of video data. 
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FIG. 7 is a block diagram of an exemplary embodiment of a storage module 
of the re-ordering apparatus. 

FIG. 8 is a block diagram of an exemplary embodiment of a second 
transpose processor of the re-ordering apparatus. 

FIG. 9 is an illustrative example of a sequence for three scrolling color bars 
over time in relation to the display of a frame of video data. 

FIG. 10 is a block diagram of another exemplary embodiment of the second 
transpose processor of the re-ordering apparatus. 



With reference to FIG. 1, a display processing system 10 includes a pre- 
processing module 12, a re-ordering apparatus 14, and a post-processing module 16. The 
pre-processing module 12 receives video data and performs certain general image 
processing steps. Pre-processing may include, for example, image enhancement (e.g., 
color correction, gamma correction, and/or uniformity correction), motion portrayal 
enhancements, and/or scaling. The re-ordering apparatus 12 receives pre-processed video 
data from the pre-processing module and performs certain steps to re-order or transpose the 
pre-processed video data. Transposing may include, for example, converting a horizontal 
scan video data stream into a vertical scan video data stream, separation of composite RGB 
video data into its constituent red (R), green (G), and blue (B) color separations and 
constructing a video data stream of downward vertically scrolling R, G, and B horizontal 
color bars, and/or separation of one or more colors into time-based sub-fields to 
individually control pixel intensity in a display device. Transposing may also include re- 
ordering of interlaced video data into progressive frames of video data or vice versa. The 
post-processing module 16 receives the transposed video data and performs certain post- 
processing steps in order to drive a selected display device. 

Typically, the display processing system 10 is embodied in one or more 
printed circuit card assemblies. The re-ordering apparatus 14 is typically implemented in 
one or more integrated circuit (IQ devices . M a preferred embodiment, the re-ordering 
apparatus 14 is programmable. In another embodiment, the re-ordering apparatus 14 is one 
or more application specific ICs (ASICs). Additional embodiments of the display 
processing system 10 and the re-ordering apparatus 14 are also possible. 
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With reference to FIG. 2, the re-ordering apparatus 14 includes a first 
transpose processor 18, a storage module or memory 20, and a second transpose processor 
22. The first transpose processor 18 receives pre-processed video data, performs 
preprogrammed steps to partially transpose the video data, and writes the partially 
transposed video data to the storage module 20. The storage module 20 stores the partially 
transposed video data in one or more blocks of memory, also referred to as frame buffers. 
The second transpose processor 22 reads the partially transposed video data from the 
storage module 20, performs certain steps to complete the re-ordering or transposing of the 
video data, and communicates the transposed video data to the post-processing module 16. 

In a preferred embodiment, the first transpose processor 18, storage module 
20, and second transpose processor 22 are fabricated on a common substrate S to define a 
unitary programmable IC. The IC includes video input terminals T*, re-ordered video 
output terminals T vo , and terminals T p for programming or burning" of internal 
programmable components or devices (i.e., flexible hardware blocks). In another 
embodiment, the first transpose processor 18 and second transpose processor 22 are 
combined in a programmable IC and the storage module 20 includes one or more 
connectable video RAM ICs. In still another embodiment, the first transpose processor 22 
includes a first programmable IC, the storage module 20 includes one or more additional 
ICs, and the second transpose processor 22 includes a second programmable IC. In yet 
another embodiment the first transpose processor 18, storage module 20, and second 
transpose processor 22 are combined in an ASIC. In yet another embodiment, the first and 
second transpose processors 18, 22 may be arranged in one or more ASICs and the storage 
module 20 may include one or more additional ICs. Additional embodiments of the re- 
ordering apparatus 14 are also contemplated. 

With reference to FIG. 3, another embodiment of the re-ordering apparatus 
14 includes a storage module 120 with the first and second transpose processors 18, 22. 
The storage module 120 further includes a memory that is segmentable into a first storage 
block 24 and a second storage block 26. The first and second storage blocks 24, 26 are 
used in ping-pong fashion by the first and second transpose processors 18, 22. lh other 
30 words, while the first transpose processor 18 writes partially transposed video data to one 
or more frame buffers in the first storage block 24, the second transpose processor 22 reads 
the partially transposed video data from one or more frame buffers in the second storage 
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block 26. Once these read and write operations are complete, the first and second 
transpose processors 18, 22 switch to perform read and write operations on the alternate 
storage block (i.e., 26, 24). These alternating cycles continue in ping-pong fashion as long 
as video data is being processed. 

With reference to FIG. 4, an exemplary embodiment of the first transpose 
processor 18 includes an input communication process 28, a write process 30, a storage 
module addressing process 31, an RGB separation process 32, a sub-field generation 
process 34, a sub-field lookup table 36, and a configuration identification process 38. 
Other embodiments of the first transpose processor 18 may be created from various 
combinations of these processes. In any of these various embodiments and others, the first 
transpose processor 18 may also include additional processes associated with the partial re- 
ordering or transposing of video data. For example, a color space conversion process, a 
special effects process, etc. may be included (if it is not performed as part of pre- 
processing). 

In the embodiment being described, the input communication process 28 
receives pre-processed video data from me pre-processing module and provides the pre- 
processed video data to one or more of the other processes. As shown, the input 
communication process 28 is in communication with the write process 30, the RGB 
separation process 32, and the sub-field generation process 34. Typically, the pre- 
processed video data is a stream of RGB video data. However, other forms of video data 
(e.g., monochrome or YUV video data) are also possible. 

The RGB separation process 32 separates RGB video data into separate R, 
G, and B video data streams. As shown, the separate R, G, and B video data streams are 
communicated to the write process 30 and the sub-field generation process 34. 

The sub-field generation process 34 receives a video data stream and 
converts each pixel of the video data stream into data bits for N sub-fields (i.e., sub-field 0 
through sub-field N-l) using the sub-field lookup table 36. The sub-field lookup table 36 
stores a previously defined cross-reference between pixel data values and a corresponding 
set of N sub-field bit values for the monochrome and RGB color components. Typically, 
the sub-field lookup table 36 is embedded memory. Alternatively, the sub-field lookup 
table 36 can be external memory. The sub-field lookup table 36 may be a block of 
memory associated with one or more components making up the storage module 20, 120. 
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As shown, a sub-field data stream is communicated to the write process 30 and the RGB 
separation process 32. 

The RGB separation process 32 separates RGB video data into separate R, 
G, and B video data streams and RGB sub-field data into R, G, and B sub-field data 
streams. As shown, the separate R, G, and B video and sub-field data streams are 
communicated to the write process 30. 

In a first exemplary operation, the first transpose processor 18 receives a 
pre-processed stream of RGB video data at the input communication process 28 and 
provides the pre-processed video data to the write process 30. The storage module 
addressing process 31 includes one or more address pointers, a process for incrementing 
the address pointers, a process for determining when the total number of pixels and/or scan 
lines to be written during a frame repetition cycle have been written, and a process for 
resetting the address pointers when the repetition cycle is complete. The video data 
address process 31 provides address information to the write process 30. The write process 
30 writes the pre-processed stream of RGB video data to a frame buffer in the storage 
module 20, 120 allocated to store RGB video data according to the address information. 
The first transpose process can be viewed as a de-multiplexing operation with respect to 
the re-ordering of horizontal scan lines into a frame of video data. 

If the RGB video data is non-interlaced, the horizontal scan lines are 
transferred into the frame buffer in sequential and consecutive fashion by the storage 
module addressing process 31. However, if the non-interlaced RGB video data is to be 
converted into interlaced RGB video data, the storage module addressing process 31 may 
direct odd horizontal scan hues to an odd frame buffer and even horizontal scan lines to an 
even frame buffer. If the RGB video data is interlaced, the storage module addressing 
process 31 may control transfers of the horizontal scan lines into the frame buffer at spaced 
intervals to effectively interlace the odd and even horizontal scan lines in the frame buffer. 
Alternatively, for interlaced RGB video data, the horizontal scan lines may be transferred 
into the odd and even frame buffers in sequential and consecutive fashion. 

In a second exemplary operation, the input communication process 28 
provides the pre-processed video data to the RGB separation process 32. The RGB 
separation process creates separate R G, and B video data streams and provides them to 
the write process 30. The write process 30 writes the separate streams of R G, and B 
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video data to separate frame buffers in the storage module 20, 120 allocated to store R 
separation, G separation, and B separation video data according to address information 
provided by the video data address process 31. 

In a third exemplary operation, the input communication process 28 
5 provides the pre-processed RGB video data to the sub-field generation process 34. The 
sub-field generation process 34, in conjunction with the sub-field lookup table 36, creates 
N sets of RGB sub-field video data and provides them to the write process 30. The write 
process 30 writes the streams of RGB sub-field video data to frame buffers in the storage 
module 20, 120 allocated to store RGB sub-field video data according to address 
1 0 information provided by the video data address process 31 . 

In a fourth exemplary operation, the input communication process 28 
provides the pre-processed video data to the sub-field generation process 34. The sub-field 
generation process 34, in conjunction with the sub-field lookup table 36, creates N sets of 
sub-field RGB video data and provides them to the RGB separation process 32. The RGB 
15 separation process 32 creates separate R, G, and B sub-field video data for each color 
separation. This results in N sets of R separation sub-field video data, N sets of G 
separation sub-field video data, and N sets of B separation sub-field video data. The RGB 
separation process provides the R, G, and B sub-field video data to the write process 30. 
The write process 30 writes the separate streams of sub-field video data to separate frame 
buffers in the storage module 20, 120 allocated to store R separation sub-field, G 
separation sub-field, and B separation sub-field video data according to address 
information provided by the video data address process 31. 

In a fifth exemplary operation, the input communication process 28 
provides the pre-processed video data to the sub-field generation process 34. The sub-field 
generation process 34, in conjunction with the sub-field lookup table 36, creates N sets of 
monochrome sub-field video data and provides them to the write process 30. The write 
process 30 writes the streams of monochrome sub-field video data to frame buffers in the 
storage module 20, 120 allocated to store monochrome sub-field video data according to 
address information provided by the video data address process 31. 

FIG. 5 A provides an illustrative example of the conversion of pixel data to 
monochrome sub-field data as required, for example, to transpose video data for 
monochrome digital micro-mirror devices (DMDs). As shown, pixel data 101 for pixel 
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(x,y) is represented by an 8-bit word 101 (i.e., bits d0-d7). The sub-field lookup table 36 
cross-references the 8-bit word 101 to sub-field data 103 for pixel (x,y). In this example, 
there are seven sub-fields (i.e., sub-field SF0 through sub-field SF6). Pixel (x,y) is 
represented by one bit in each sub-field. Thus, the monochrome sub-field data for pixel 
(x,y) is binary. 

The conversion illustrated in FIG. 5A is performed for each pixel in a frame 
of video data. Typically, temporary storage of sub-field data is implemented so that 
parallel transfers over a data bus can be performed, rather than transferring individual bits. 
If, for example, the system operates with a 32-bit data bus, it is most efficient to transfer 32 
bits of sub-field data in parallel. FIG 5C provides an illustrative example of temporary 
storage of sub-field data for an exemplary sub-field (i) within the sub-field generation 
process 34. In this example, the sub-field generation process 34 includes a plurality of 
shift registers for temporary storage. As shown in FIG. 5A, the sub-field generation 
process provides 1-bit binary data in each sub-field for each pixel of the frame. For 
example, SF i, di (item 127) represents the 1-bit binary data output for sub-field (i) for a 
given pixel. This sub-field data is temporarily stored by transferring it through a series of 
shift registers (129, 131, 133, 135). For example, in our example with a 32-bit data bus, 
there are 32 shift registers. The sub-field data for a first pixel (i.e., di 0 ,o) is initially 
transferred to a first shift register 129. When the sub-field data for a second pixel (i.e., 
dio.i) is ready to be transferred, sub-field data di 0(0 is shifted to the next shift register 131 
and sub-field data di 0(1 is transferred to the first shift register 129. This process continues 
until sub-field data for the last pixel (i.e., di x , y ) in the block is transferred to the first shift 
register 129 which is the condition shown in FIG. 5C. Note that the sub-field data di 0>0 for 
the first pixel has been shifted to the last shift register 135 and sub-field data di 0 ,i for the 
second pixel has been shifted to the next to last shift register 133. At this point, the write 
process 30 transfers a first word of sub-field data for sub-field (i) in parallel from the 
temporary shift registers to a frame buffer 137 in the storage module 20, 120 allocated for 
storage of sub-field (i). 

Of course, the entire process shown in FIG. 5C is performed in parallel for 
each sub-field (e.g., SF0 through SF 6). Additionally, the total structure of shift registers is 
implemented twice and operated in a ping-pong fashion. In other words while one set of 
shift registers is performing the serial transfers described above, the other set is performing 
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the parallel transfer and vice versa. Ping-pong operation continues until RGB sub-field 
data has been generated and stored for the entire frame. The overall process is repeated for 
each frame. 

FIG. 5B provides an illustrative example of the conversion of pixel data to 
RGB sub-field data as required, for example, to transpose video data for plasma display 
panels (PDPs) and color DMDs. As shown, pixel data 101 for pixel (x,y) is represented by 
a 24-bit word 101 (i.e., bits d0-d23). The R sub-field lookup table 36r cross-references 
eight bits of the 24-bit word 101 that specify the red color component to R sub-pixel data 
103r as a first component of the sub-field data 103 for pixel (x,y). Likewise, the G sub- 
field lookup table 36g cross-references eight bits of the 24-bit word 101 that specify the 
green color component to G sub-pixel data 103g as one component of the sub-field data 
103 for pixel (x,y). Additionally, the B sub-field lookup table 36b cross-references eight 
bits of the 24-bit word 101 that specify the blue color component to B sub-pixel data 103b 
as one component of the sub-field data 103 for pixel (x,y). In this example, there are seven 
RGB sub-fields (i.e., sub-field SF0 through sub-field SF6). Pixel (x,y) is represented by 
three bits in each sub-field, a first bit (i.e., dO-r through d6-r) representing R sub-pixel data, 
a second bit (i.e., dO-g through d6-g) representing G sub-pixel data, and a third bit (i.e., dO- 
b through d6-b) representing B sub-pixel data for the sub-fields 103. Thus, the RGB sub- 
field data for pixel (x,y) is 3-bit binary. 

FIG 5D provides an illustrative example of temporary storage of RGB sub- 
field data for an exemplary RGB sub-field (i) within the sub-field generation process 34. 
In this example, similar to FIG. 5C, the sub-field generation process 34 includes a plurality 
of shift registers for temporary storage. However, as shown in FIG. 5B, the RGB sub-field 
generation process provides 3-bit binary data in each RGB sub-field for each pixel of the 
frame. For example, di-r, di-g, and di-b (item 139) represents the 3-bit binary data output 
for RGB sub-field (i) for a given pixel. This RGB sub-field data is temporarily stored by 
transferring it through a series of 3-bit shift registers (141, 143, 145). Again, in our 
example with a 32-bit data bus, there are 32 shift registers. The RGB sub-field data for a 
first pixel (i.e., di-r 0) o, di-go, 0 di-b 0>0 ) is initially transferred to a first shift register 141. 
When the RGB sub-field data for a second pixel (i.e., di-r 0 ,,, di-g^ di-b 0>1 ) is ready to be 
transferred, RGB sub-field data di-r 0 , 0> di-g 0 ,o di-b 0 ,o is shifted to the next shift register 143 
and RGB sub-field data di-r 0 ,i, di-go,! di-b 0 ,, is transferred to the first shift register 141, 
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This process continues until RGB sub-field data for the last pixel (i.e., di-r x>y , di-g x , y di-b x y ) 
in the block is transferred to the first shift register 141 which is the condition shownX 
FIG. 5D. Note.that the RGB sub-field data di-r 0 , 0> di-go )0 di-b 0 , 0 for the first pixel has been 
shifted to the last shift register 147 and RGB sub-field data di-r 0jl , di-go,, di-b 0> , for the 
second pixel has been shifted to the next to last shift register 145. At this point, the write 
process 30 transfers a first word of RGB sub-field data for RGB sub-field (i) in parallel 
from the temporary shift registers to an RGB frame buffer 149 in the storage module 20, 
120 allocated for storage of RGB sub-field (i). 

Of course, like the process of FIG. 5C, the entire process shown in FIG. 5D 
is performed in parallel for each RGB sub-field (e.g., SF0 through SF 6). Additionally, the 
total structure of shift registers is implemented twice and operated in a ping-pong fashion 
until RGB sub-field data has been generated and stored for the entire frame. The overall 
process is repeated for each frame. 

Referring more generally to the sub-field generation process 34 (FIG. 4), 
each sub-field of the N sub-fields corresponds to a previously defined unit of time. 
Typically, sub-field 0 is defined by a basic unit of time (t°), sub-field 1 is defined by t 1 , 
etc., and sub-field N-l is defined by f". However, alternate schemes for time units and 
scaling are possible. Selection of time unit values and/or scaling could be variable for 
compatibility with multiple types of display devices that implement different time units 
and/or different scaling schemes. 

FIG. 6 provides an illustrative example of the display of eight sub-fields 
105 over time in relation to the display of a composite frame of video data 107. It is 
understood that the displayed sequence of sub-fields produces an image that is generally 
equivalent to a composite frame of video data. Thus, the sequence of all sub-fields relates 
to conventional frame repetition rates (e.g., 30 Hz, 60 Hz, etc.). In this example, the basic 
time unit is t and each sub-field is displayed for time t. Thus, sub-field SF0 is displayed 
between 0 and t, sub-field SF1 is displayed between t and 2t, etc., and sub-field SF7 is 
displayed between 7t and 8t. The total time (8t) to display the eight sub-fields (i.e., SF0- 
SF7) corresponds to conventional frame rates. If, for example, the conventional frame 
repetition rate is 50 Hz, the sub-field display rate for this example is approximately 400 



Hz 
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Since each sub-field corresponds to a unit of time, the combination of l's 
and 0's in the sub-field data bits determines a percentage of time that the corresponding 
pixel will be muminated during each composite frame of video data. Conversion of pixel 
data to a set of sub-field bits is useful for driving display devices comprised of a matrix of 
individually controlled components (e.g., PDPs, DMDs, etc.). Typically, each of these 
individually controlled components is associated with a pixel or sub-pixel in the image to 
be displayed. Varying the amount of time the component is on/off controls the intensity of 
each individually controlled component. Differences in intensity result in different shades 
of color for individual pixels in the displayed image. 

With continued reference to FIG. 4, an embodiment of the first transpose 
processor 18 that includes the input communication process 28, write process 30, and 
storage module addressing process 31 is compatible with transpose scan cathode ray tubes 
(CRTs), re-ordering of interlaced video data to non-interlaced video data, and vice versa. 
An embodiment of the first transpose processor 18 that includes the input communication 
process 28, RGB separation process 32, write process 30, and storage module addressing 
process 31 is compatible with liquid crystal on silicon (LCOS) devices. An embodiment of 
the first transpose processor 18 that includes the input communication process 28, sub-field 
generation process 34, sub-field lookup table 36, write process 30, and storage module 
addressing process 31 is compatible with PDPs and monochrome DMDs. An embodiment 
of the first transpose processor 18 that includes the input communication process 28, RGB 
separation process 32, sub-field generation process 34, sub-field lookup table 36, write 
process 30, and storage module addressing process 31 is compatible with color DMDs. 

The configuration identification process 38 in the first transpose processor 
18 facilitates use of the re-ordering apparatus 14 in various dedicated display processing 
systems 10. For example, when a display processing system 10 is manufactured for a 
dedicated display device, the configuration identification process 38 can be used to tailor 
the active processes within the first transpose processor 18 to those associated with the 
dedicated display device. Thus, the generic processes associated with the first transpose 
processor 18 can be activated or deactivated to increase processing efficiency. 

With reference to FIG. 7, an exemplary embodiment of a storage module 20 
includes one or more memory blocks. Each memory block stores partially transposed 
video data from the first transpose processor 18 in one or more frame buffers. A first 



- 13 - 



WO 2004/057560 



PCT/TO2003/005989 



memory block 40 is allocated for storing partially transposed video data associated with a 
composite RGB frame in an RGB frame buffer. The first memory block 40 is compatible 
with transpose scan CRTs. The first memory block 40 is also compatible with re-ordering 
interlaced video data into non-interlaced video data if the first transpose processor 
combines the odd and even horizontal scan lines. If the second transpose processor 
combines the odd and even horizontal scan lines, the first memory block 40 includes an 
odd sub-block to store the odd horizontal scan line and an even sub-block to store the even 
horizontal scan lines. Additionally, the first memory block 40 is compatible with re- 
ordering non-interlaced video data into interlaced video data if the second transpose 
processor separates the odd and even horizontal scan lines. If the first transpose processor 
separates the odd and even horizontal scan lines, the first memory block 40 includes an odd 
sub-block to store the odd horizontal scan line and an even sub-block to store the even 
horizontal scan lines. 

A second memory block 42 is allocated for storing partially transposed 
video data associated with separate R, G, and B frames., Three memory sub-blocks 44, 46, 
48 are allocated within the second memory block 42 as R separation, G separation, and B 
separation frame buffers, respectively, to store the separated R, G, and B video data. The 
second memory block 42 is compatible with LCOS devices. 

A third memory block 50 is allocated for storing partially transposed video 
data associated with N sub-fields. N sub-blocks (e.g., 52, 54) are allocated within the third 
memory block 50 as sub-fields 0 through N-l frame buffers to store sub-field video data. 
The third memory block 50 is compatible with monochrome DMDs. 

A fourth memory block 51 is allocated for storing partially transposed video 
data associated with N RGB sub-fields. N sub-blocks (e.g., 53, 55) are allocated within the 
fourth memory block 51 as RGB sub-field 0 through N-l frame buffers to store RGB sub- 
field video data. The fourth memory block 51 is compatible with PDPs. 

A fifth memory block 56 is allocated for storing partially transposed video 
data associated with N sub-fields for each of R, G, and B color separations. N sub-blocks 
(e.g., 58, 60) are allocated as R separation sub-fields 0 through N-l to store sub-field video 
data associated with the R color separation. Likewise, N sub-blocks (e.g., 62, 64) are 
allocated as G separation sub-fields 0 through N-l to store sub-field video data associated 
with the G color separation and N sub-blocks (e.g., 66, 68) are allocated to store like sub- 
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fields associated with the G color separation. Therefore, given N sub-fields for each color 
separation, the fourth memory block 56 includes 3N sub-blocks. The fifth memory block 
56 is compatible with color DMDs. 

In various other embodiments, the storage module 20 may include any 
combination of the first, second, third, fourth, and fifth memory blocks. Additional 
memory blocks for storage of other types of partially transposed video data frames are also 
possible. Moreover, the configuration of memory blocks shown in FIG. 7 and any other 
configuration can have duplicate memory blocks for alternating between write and read 
operations in a ping-pong fashion as described above in reference to FIG. 3. 

Of course, in embodiments where the re-ordering apparatus is not required 
to simultaneously support each type of re-ordering, certain memory blocks can share 
physical memory. For example, if transpose scan CRT re-ordering is required at a 
particular time, the first memory block can overlay the second, third, fourth, and fifth 
memory block. Similarly, if only color DMD re-ordering is required at a particular time, 
the fifth memory block can overlay the first, second, third, and fourth memory blocks. 
Typically, the generic re-ordering apparatus is ultimately dedicated to one type of re- 
ordering and the physical memory is sized for the re-ordering processing that requires the 
most memory. 

With reference to FIG. 8, an exemplary embodiment of the second 
transpose processor 22 includes a video data addressing process 70, an RGB read process 
72, an output communication process 74, a color bar sequencing process 76, an R 
separation read process 78, a G separation read process 80, a B separation read process 82, 
a sub-field sequencing process 88, a sub-field read process 90, an RGB sub-field read 
process 91, and a configuration identification process 92. Other embodiments of the 
second transpose processor 22 may be created from various combinations of these 
processes. In any of these various embodiments and others, the second transpose processor 
22 may also include additional processes associated with the re-ordering or transposing of 
video data. For example, a process to combine color separations, a special effects process, 
etc. maybe included (if it is not performed as part of post-processing). 

In the embodiment being described, the video data addressing process 70 
includes one or more address pointers for locating video data in frame buffers of the 
storage module 20, 120, a process for incrementing the address pointers, a process for 
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determining when the total number of pixels and/or scan lines to be read during a frame 
repetition cycle have been read, and a process for resetting the address pointers when the 
repetition cycle is complete. As shown, the video data addressing process 70 is in 
communication with the RGB read process 72, R separation read process 78, G separation 
read process 80, B separation read process 82, sub-field read process 90, and RGB sub- 
field read process 91. Alternate methods of addressing video data in the frame buffers are 
also possible. 

The RGB read process 72 receives address information from the video data 
addressing process 70 and sequentially reads pixel data from the RGB frame buffer 40. 
Typically, the address information from the video data address process 70 to the RGB read 
process 72 is incremented in a manner so that the pixel data read from the RGB frame 
buffer forms descending vertical scan lines that move from left to right across the frame. 
The RGB read process 72 provides this transposed RGB video data stream to the output 
communication process 74. The output communication process 74 provides the transposed 
RGB video data stream to the post-processing module 16. As described above, the 
transposed RGB video data stream provided by the second transpose processor 22 is 
compatible with transpose scan CRTs. 

Alternatively, the video data address process 70 may be incremented in a 
manner so that the pixel data read from the RGB frame buffer form scan lines in other 
suitable orientations. Moreover, the scan lines may be advanced right or left and/or up or 
down, depending the desired characteristics for compatibility with various displays. 

If the RGB video data is non-interlaced, the scan lines are read from the 
frame buffer in sequential and consecutive fashion by the RGB read process 72 as directed 
by the video data addressing process 70. However, if the non-interlaced RGB video data is 
to be converted into interlaced RGB video data, the video data addressing process 70 direct 
the RGB read process 72 to construct two interlaced frames from each frame of video data 
in the RGB frame buffer. In a first interlaced frame, the RGB read process 72 reads odd 
scan lines from the RGB frame buffer. Then, in a second interlaced frame, the RGB read 
process 72 reads even scan lines from the RGB frame buffer. If the first transpose 
processor has already separated the odd and even scan lines, the video data addressing 
process 70 directs the RGB read process 72 to the odd frame buffer and then to the even 
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frame buffer. Of course, in any of these processes the sequence can be reversed to even 
and then odd. 

If the RGB video data is interlaced and is to be converted to non-interlaced, 
the video data addressing process 70 directs the RGB read process 72 to alternate between 
reading an odd scan line from the odd frame buffer and an even scan line from the even 
frame buffer. If the first transpose processor has already combined the odd and even scan 
lines, the video data addressing processor 70 directs the RGB read process 72 to read scan 
lines sequentially and consecutively from the RGB frame buffer. 

The color bar sequencing process 76 is based on display types that display 
an illumination pattern with a sequence of color bars (e.g., LCOS devices). Typically, 
there are three color bars in the sequence (FIG. 9, items 109, 111, 113). Normally, the 
sequence is red-green-blue from top to bottom (e.g., item 115, 117, 119), although other 
sequences are possible. The color bar sequencing process 76 also includes a value 
associated with the number of horizontal scan lines in each color bar. Typically, each 
color bar has the same number of horizontal scan lines. Thus, the number of scan lines in 
each bar is usually approximately one third of the horizontal scan lines in the R, G, and B 
separation frame buffers 44, 46, 48 and the subsequent frames to be rendered on'a selected 
display. For example, if the frames include 600 horizontal scan lines, each color bar (items 
115, 117, 119) includes approximately 200 scan lines. The illumination pattern also 
includes horizontal black bars (e.g., three or four scan lines) (items 151, 153, 155) between 
the color bars (items 115, 117, 119). Typically, the horizontal black bars are laid over 
several scan lines by the display device. 

Hence, as shown in a view of the illumination pattern at time tl, lines 1-4 
are occupied by a first black bar 151; the red color bar 115 is illuminated at lines 5-200; 
lines 201-204 are occupied by a second black bar 153; the green color bar 117 is 
illuminated at lines 205-400; lines 401-404 are occupied by a third black bar 155; and the 
blue color bar 119 is illuminated at lines 405-600. Of course, other schemes for arranging 
the red, green, and blue color bars and the black bars are possible. 

As shown in FIG. 8, the color bar sequencing process 76 is in 
communication with the video data addressing process 70. The video data addressing 
process 70 receives sequence and color bar size information from the color bar sequencing 
process 76 and controls address pointers associated with the R separation, G separation, 
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and B separation frame buffers 44, 46, 48 accordingly. The R separation read process 78 
receives address information from the video data addressing process 70 and sequentially 
reads pixel data from the R separation frame buffer 44. Likewise, the G separation read 
process 80 receives address information from Ihe video data addressing process 70 and 
sequentially reads pixel data from the G separation frame buffer 46. The B separation read 
process 82 also receives address information from the video data addressing process 70 
and sequentially reads pixel data from the B separation frame buffer 48. 

For example, as shown in FIG. 9, for frames with 600 horizontal scan lines 
and red-green-blue color bar sequences, at initialization the iUumination process begins 
when horizontal scan line #1 of the R separation frame buffer, horizontal scan line #201 of 
the G separation frame buffer, and horizontal scan line #401 of the B separation frame 
buffer are iUuminated on the display. In this R G, B sequence, each scan line is 
incremented and illuminated on the display until the three color bar illumination pattern is 
filled. This point is reflected at time tl in FIG. 9 and depicted by item 109. 

At time tl, the update process begins as the color bars are scrolled 
downward one scan line at a time. For example, at time tl, the R separation read process 
78 reads video data from horizontal scan line #201 of the R separation frame buffer 44 and 
communicates it to the output communication process 74. The G separation read process 
80 reads video data from horizontal scan line #401 of the G separation frame buffer 46 and 
communicates it to the output communication process 74. The B separation read process 
82 reads video data from horizontal scan line #1 of the B separation frame buffer 48 and 
communicates it to the output communication process 74. The output communication 
process 74 provides the video data for the red, green, and blue scan lines to the post- 
processing module 16. Note that at time tl scan lines 1, 201, and 401 are below the black 
bars 151, 153, 155 and are the next scan line down from the color bars in the illumination 
pattern. 

Next, the color bar sequencing process 76 increments each scan line and the 
process is repeated. For example, the R separation read process 78 reads scan line #202 
from the R separation frame buffer, the G separation read process 80 reads scan line #402 
from the G separation frame buffer, and the B separation read process 82 reads scan line #2 
from the B separation frame. The color bar update process is continually repeated in this 
manner. Two hundred scan lines later, at t2, the R separation read process 78 reads scan 
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line #401 from the R separation frame buffer, the G separation read process 80 reads scan 
line #1 from the G separation frame buffer, and the B separation read process 82 reads scan 
hne #201 from the B separation frame buffer. The corresponding illumination pattern 111 
at t2 shows the black bars at the top of blue, red, and green color bars. Similarly, two 
hundred additional scan lines later, at t3, the R separation read process 78 reads scan line 
#1 from the R separation frame buffer, the G separation read process 80 reads scan line 
#201 from the G separation frame buffer, and the B separation read process 82 reads scan 
line #401 from the B separation frame buffer. The corresponding illumination pattern 113 
at t3 shows the black bars at the top of green, blue, and red color bars. At t3, all 600 scan 
lines for each color separation have been provided for a first frame of video data and a new 
frame repetition cycle begins. 

Referring again to FIG. 8, typically, the address information from the video 
data address process 70 to the R, G, and B separation read process 78, 80, 82 is 
incremented in a manner so that the pixel data read from the frame buffers form horizontal 
scan lines from left to right across the frame that advance downward through the frame 
buffer. Alternatively, the video data address process 70 may be incremented in a manner 
so that the pixel data read from the R separation, G separation, and B separation frame 
buffer form scan lines in other suitable orientations. Moreover, the scan lines may be 
advanced right or left and/or up or down, depending the desired characteristics for 
20 compatibility with various displays. 

As described above, FIG. 9 shows that the R, G, and B color bars in the 
illumination pattern on the device scroll downward and reappear at the top of the frame 
over time. In the first view of the illumination pattern 109 at tl, the color bars are in a red- 
green-blue sequence from top to bottom, hi the second view of the illumination patter 111 
at t2, the color bars have scrolled downward 200 lines. Similarly, in the third view of the 
illumination pattern 113 at t3, the color bars have scrolled downward another 200 lines. At 
t3, the second transpose processor 22 is ready to advance to the next frame. 

FIG. 9 also shows that, for frames of video data with 600 scan lines, at least 
600 sequences of red-green-blue scan lines must be communicated to the post-processing 
module 16 in order to include all of the scan lines from each of the color separation frames 
during a frame repetition cycle. It also shows that each sequence of red-green-blue scan 
lines should be communicated at a consistent interval. As described above, the transposed 
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video data stream provided by the second transpose processor 22 is compatible with LCOS 
devices. 

Returning to FIG. 8, the sub-field sequencing process 88 includes a value 
associated with the number of sub-fields generated, a sequence for reading the sub-fields, 
and a value associated with the amount of time each sub-field is to be displayed. The sub- 
field sequencing process 88 is in communication with the video data addressing process 
70. The video data addressing process 70 receives sub-field information from the sub-field 
sequencing process 88 and controls address pointers associated with the sub-field 0 
through sub-field N frame buffers 52, 54 accordingly. 

The sub-field read process 90 receives address information from the video 
data addressing process 70 and sequentially reads pixel data from the sub-field 0 frame 
buffer 52. Typically, the address information from the video data address process 70 to the 
sub-field read process 90 is incremented in a manner so that the pixel data read from the 
frame buffers form horizontal scan lines extending from left to right and advancing down 
the frame. The sub-field read process 90 provides the sub-field 0 video data to the output 
communication process 74. The output communication process 74 provides the sub-field 0 
video data to the post-processing module 16. 

Once the sub-field read process 90 has processed all the video data 
associated with the sub-field 0 frame buffer 52 and at an appropriate time interval (i.e., 
sub-field repetition rate), the video data address process 70 directs the sub-field read 
process 90 to read video data from the next sub-field frame buffer (e.g., sub-field 1 frame 
buffer). The second transpose processor 22 processes video data from the next sub-field 
frame buffer as described above for sub-field 0 and continues processing each sequential 
sub-field in the same manner until the sub-field N frame buffer 54 is processed. Once the 
sub-field N frame buffer 54 is processed, the frame repetition cycle is complete and the 
second transpose processor 22 is ready to process the next frame beginning with sub-field 
0. As described above, the transposed sub-field video data provided by the second 
transpose processor 22 is compatible with monochrome DMDs. 

The sub-field sequencing process 88 also operates as described above in 
conjunction with the RGB sub-field read process. The video data addressing process 70 
receives RGB sub-field information from the sub-field sequencing process 88 and controls 
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address pointers associated with the RGB sub-field 0 through RGB sub-field N frame 
buffers 53, 55 accordingly. 

The RGB sub-field read process 91 receives address information from the 
video data addressing process 70 and sequentially reads pixel data from the RGB sub-field 
0 frame buffer 53. Typically, the address information from the video data address process 
70 to the RGB sub-field read process 91 is incremented in a manner so that the pixel data 
read from the frame buffers form horizontal scan lines extending from left to right and 
advancing down the frame. The RGB sub-field read process 91 provides the RGB sub- 
field 0 video data to the output communication process 74. The output communication 
process 74 provides the sub-field 0 video data to the post-processing module 16. 

Once the RGB sub-field read process 91 has processed all the video data 
associated with the RGB sub-field 0 frame buffer 53 and at an appropriate time interval 
(i.e., sub-field repetition rate), the video data address process 70 directs the RGB sub-field 
read process 91 to read video data from the next RGB sub-field frame buffer (e.g., RGB 
sub-field 1 frame buffer). The second transpose processor 22 processes video data from 
the next RGB sub-field frame buffer as described above for RGB sub-field 0 and continues 
processing each sequential RGB sub-field in the same manner until the RGB sub-field N 
frame buffer 55 is processed. Once the RGB sub-field N frame buffer 55 is processed, the 
frame repetition cycle is complete and the second transpose processor 22 is ready to 
process the next frame beginning with RGB sub-field 0. As described above, the 
transposed RGB sub-field video data provided by the second transpose processor 22 is 
compatible with PDPs. 

The configuration identification process 92 in the second transpose 
processor 22 facilitates use of the re-ordering apparatus 14 in various dedicated display 

25 processing systems 10. For example, when a display processing system 10 is 
manufactured for a dedicated display device, the configuration identification process 92 
can be used to tailor the active processes within the second transpose processor 18 to those 
associated with the dedicated display device. Thus, the generic processes associated with 
the second transpose processor 18 can be activated or deactivated to increase processing 

30 efficiency. 

With reference to FIG. 10, another exemplary embodiment of the second 
transpose processor 122 includes the sub-field sequencing process 88, the video data 
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addressing process 70, an R separation sub-field read process 94, a G separation sub-field 
read process 96, a B separation sub-field read process 98, and an output communication 
process 74. Another embodiment of the second transpose processor includes the processes 
of FIG. 10 and the processes of the second transpose process 22 of FIG. 8. 

In the embodiment being described, the video data addressing process 70 is 
as described above for the second transpose processor 22 of FIG. 8. The sub-field 
sequencing process 88 includes a one or more values associated with the number of R, G, 
and B separation sub-fields generated, a sequence for reading the R, G, and B separation 
sub-fields, and a value associated with the amount of time each sub-field is to be displayed. 
The sub-field sequencing process 88 is in communication with the video data addressing 
process 70. The video data addressing process 70 receives R separation sub-field 
information from the sub-field sequencing process 88 and controls an address pointer 
associated with the R separation sub-field 0 through sub-field N frame buffers 58, 60, 
accordingly. Likewise, the video data addressing process 70 receives G separation sub- 
field information and controls an address pointer associated with the G separation sub-field 
0 through sub-field N frame buffers 62, 64. Additionally, the video data addressing 
process 70 receives B separation sub-field information and controls an address pointer 
associated with the B separation sub-field 0 through sub-field N frame buffers 66, 68. 

The R separation sub-field read process 94 receives address information 
from the video data addressing process 70 and sequentially reads pixel data from the R 
separation sub-field 0 frame buffer 58. Typically, the address information from the video 
data address process 70 to the R separation sub-field read process 94 is incremented in a 
manner so that the pixel data read from the frame buffers form horizontal scan lines 
extending from left to right and advancing down the frame. The R separation sub-field 
read process 94 provides the sub-field 0 video data to the output communication process 
74. The output communication process 74 provides the sub-field 0 video data to the post- 
processing module 16. 

Once the R separation sub-field read process 94 has processed all the video 
data associated with the R separation sub-field 0 frame buffer 58 and at an appropriate time 
interval (i.e., sub-field repetition rate), the video data address process 70 directs the R 
separation sub-field read process 94 to read video data from the next R separation sub-field 
frame buffer (e.g., R separation sub-field 1 frame buffer). The second transpose processor 
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122 processes video data from the next R separation sub-field frame buffer as described 
above for R separation sub-field 0 and continues processing each sequential R separation 
sub-field in the same manner until the R separation sub-field N frame buffer 60 is 
processed. 

The second transpose processor 122 reads video data from the G separation 
sub-field frame buffers 62, 64 using the G separation sub-field read process 96 and 
processes the G separation sub-field video data in the same manner as described above for 
the R separation sub-field. Likewise, the second transpose processor 122 reads video data 
from the B separation sub-field frame buffers 66, 68 using the B separation sub-field read 
process 98 and processes the B separation sub-field video data in the same manner. The 
second transpose processor 122 processes the G and B separation sub-field data 
substantially in parallel with the R separation sub-field data for a given frame with respect 
to sub-field timing and frame repetition cycles. 

Once the R, G, and B separation sub-field N frame buffers 60, 64, 68 are 
processed, the frame repetition cycle is complete and the second transpose processor 122 is 
ready to process the next frame beginning with R, G, and B separation sub-field 0. As 
described above, the transposed R, G, and B sub-field video data provided by the second 
transpose processor 122 is compatible with color DMDs. 

While the invention is described herein in conjunction with exemplary 
embodiments, it is evident that many alternatives, modifications, and variations will be 
apparent to those skilled in the art. Accordingly, the embodiments of the invention in the 
preceding description are intended to be illustrative, rather than limiting, of the spirit and 
scope of the invention. More specifically, it is intended that the invention embrace all 
alternatives, modifications, and variations of the exemplary embodiments described herein 
that fall within the spirit and scope of the appended claims or the equivalents thereof. 
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